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How  good  are  global  Newton  methods.   Part  2 

A.  A.  Goldstein* 

In  the  first  part  of  this  ms.  we  made  some  observations  about  global  Newton  methods 
on  a  simple  class  of  mappings  from  a  real  separable  Hilbert  space  H  into  H.  The  map 
F  was  assumed  to  be  everywhere  difFerentiable  with  a  derivative  D  that  was  onto  and 
satisfied  fi\\h\\  <  \\D(x)h\\  <  X\\h\\,  for  all  h  6  H  and  some  /j,  >  0.  Relying  on  theorems  of 
Nemerovsky  and  Yudin(1977),  we  showed  that  no  formulation  of  a  global  Newton  method 
could  achieve  better  than  linear  convergence  at  a  certain  specified  rate  for  every  member 
of  the  class.  Assuming  that  D  was  uniformly  Lipschitz  continuous  with  constant  L  it 
was  easy  to  utilize  the  Kantorovich  inequalities  (1948).  Points  satisfying  the  Kantorovich 
inequalities  are  guaranteed  to  be  a  satisfactory  initial  point  for  Newton's  method.  By 
satisfactory,  we  mean  that  the  sequence  converges  to  a  root  at  a  quadratic  rate,  as  will 
be  seen  below.  Following  a  similar  terminology  of  Smale(1986),  such  points  will  be  called 
approximate  roots. 

We  used  the  Kantorovich  inequalities  to  formulate  a  coarse  version  of  Smale's  global 
Newton  method  to  obtain  the  complexity  of  the  algorithm  in  this  setting.  The  Kan- 
torovich condition  is  :  if  xo  satisfies  ||Z)-1(;ro)||  \\D~1(xo)F(xo)\\L  —  (3  rj  L  <  .5 
then  xq  is  an  approximate  root.  Here  L  is  the  Lipschitz  constant  for  D  on  the  ball 
B  =  {x  G  H  :  \\x  —  x0\\  <  2||J9-1(a:o)ir'(xo)||}.  We  found  that  starting  at  x0  we  could 
achieve  a  point  satisfying  the  Kantorovich  inequalities  in  less  than: 

11.46  [\\F(x0)\\L/n2  \ln  (1.443 ln8Q)  steps 

where:  L  is  the  global  Lipschitz  constant,  and  Q  =  A//i  the  condition  number.  It  is 
noteworthy  that  this  algorithm  is  insensitive  to  the  condition  number.  When  the  word 
'steps'  appears  in  this  paper,  as  above,  we  mean  the  preceding  formula  to  be  rounded  up 
to  the  nearest  integer. 

Some  numerical  experiments  however  were  disappointing.  The  poor  performance  stemmed 
from  our  reliance  on  the  Kantorovich  inequality.  This  inequality  is  overconservative  when 
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the  dimension  of  H  exceeds  1.  In  a  test  example  even  though  we  estimated  L  along  only 
one  ray  (in  the  direction  of  the  Newton  step)  and  thus  determined  a  L  that  was  a  lower 
bound,  we  found  approximate  roots  where  the  Kantorovich  constant  /3  r)  L  was  several 
thousand  instead  of  <  1/2.  (See  definition  1.5  below).  For  this  reason  we  undertook  to 
revise  the  Kantorovich  inequalities,  hoping  to  obtain  better  sufficient  conditions.  We  shall 
do  this  by  avoiding  the  Schwarz  inequality  at  a  key  spot.  In  general  we  were  guided  by 
Kantorovich's  original  proof.  A  parameter  K  replaces  L  on  the  ball  B.  Estimates  are  given 
for  the  decrease  in  the  norm  of  the  vector  valued  function.  This  leads  to  the  definition  of  a 
an  e  approximate  root.  We  believe  this  concept  will  be  useful  in  the  further  development  of 
global  Newton  algorithms.  The  estimates  we  give  for  the  convergence  rates  can  probably 
improved  by  a  one  dimensional  analysis,  as  was  done  by  Gragg  and  Tapia(1974)  for  the 
Kantorovich  Theorem.. 

One  consequence  of  the  revised  proof  is  that  the  derivative  operator  need  not  be  continuous, 
although  Lipschitz  continuity  is  convenient  in  a  neighborhood  of  each  root.  As  an  example 
we  consider  the  problem  of  solving  linear  inequalities.  (Phase  1  linear  programming)  By 
the  use  of  Lagrange  multipliers  the  method  presented  here  can  be  extended  to  linear  pro- 
gramming and  other  types  of  programs.  We  shall  however  only  consider  linear  inequalities 
in  this  ms.  The  idea  of  using  Newton's  method  for  linear  programming  may  be  found  in 
Smale(1986).  Our  technique  will  be  to  use  a  penalty  function  approach.  In  this  setting 
we  have  a  twice  differential  convex  function  to  minimize,  with  jump  discontinuities  in  the 
second  derivative.  For  the  code  we  refurbished  an  old  global  Newton  method  of  our  own. 
This  was  easy  because  it  was  already  up  and  running.  We  tried  the  method  on  an  example 
due  to  C.  Blair(in  Kortanek  and  Shi  1987)  that  is  a  version  of  the  famous  Klee-Minty 
example.  This  problem  was  suggested  to  us  by  Ken  Kortanek,  and  we  are  thankful  for  his 
kind  help.  While  Ken  was  visiting,  he  ran  his  scaling  (modified  Karmarker)  algorithm  on 
my  computer  for  a  benchmark  in  the  10  variable  case.  The  robust  'Superlindo'  by  Linus 
Schrage  was  also  used  as  a  benchmark  for  these  problems.  For  8,  10,  and  12  variables 
Superlindo  took  35,  311,  and  2236  iterations  respectively.  Our  algorithm  hardly  changed 
in  the  number  of  steps  versus  dimension.  Ken  Kortanek  remarked  he  noticed  the  same 
phenomena  with  their  algorithm.  In  the  appendix  appears  a  list  of  15  consecutive  runs 
for  the  case  n=12  with  the  components  of  the  initial  point  being  fed  by  a  random  number 
generator  with  values  between  -1000  and  1000.  The  number  of  steps  until  termination  ran 
between  6  Newton  steps  plus  2  gradient  steps,  and  12  Newton  steps  plus  3  gradient  steps. 


The  average  was  8  Newton  steps  and  19/15  gradient  steps.  Full  double  precision  accuracy 
was  achieved.  The  Kortanek-Shi  algorithm  in  the  10  variable  case  was  almost  as  fast  as 
ours  for  this  case,  but  it  achieved  only  3  significant  figure  accuracy. 

These  spectacular  results  were  unexpected.  Unlike  the  Smale  global  Newton  method, 
which  we  as  yet  have  not  implemented,  the  method  we  used  is  sensitive  to  the  condition 
number  of  the  system.  See  3.0  below. 

There  remains  to  test  the  algorithm  on  a  general  mix  of  problems  to  see  if  it  is  worth 
adding  to  the  armamentarium  of  linear  programming.  Thus  the  question  of  whether  we 
have  a  viable  method  is  not  settled  at  this  time. 


In  what  follows,  the  Kantorovich  inequality  will  be  sharpened.  Let  f  be  Frechet  differen- 
tiable  mapping  between  real  Banach  spaces  E  and  F.  Let  f'(x)  denote  the  derivative  at  x 
and  f'_i{x)  its  inverse.  The  Kantorovich  inequality  states  that  if  x0  is  given  such  that  /'  is 
Lipschitz  continuous  with  constant  K  on  the  ball  {x  6  E  :  \\x  —  xo\\  <  2\\f'_1(xo)f(xo)\\  = 
2  770},  if  ll/-i(xo)||  =  A)  and  if  noftoK  <  1/2,  then  xq  is  an  approximate  root.  This 
means  that  the  sequence  generated  by  Newton's  method  will  converge  quadratically  to  a 
root  at  least  as  fast  as  the  rate  estimated  by  the  theorem  below. 

THEOREM  1.0  Let  f  be  a  map  between  real  Banach  spaces  E  and  F.  Assume 
f  is  Frechet  differentiable  on  an  open  subset  E'  of  E.  Let  xq  £  E'  be  given  such  that 
(/'(xo))_1  =  f'-i(xQ)  exists.  Set 

Vo  =  ||/li(*o)/(*o)|| 

S  =  {  x  €  E  :  \\x  —  xq  II  <  1.68  770  }.    Assume  that  S  C    E' 

Set 
A)  =  ||/-i(^o)||  ,      and  let 
5'  =  {*€5:||/l1(x)||  <2.3/M- 
Finally  set: 

K  =  { *"p!fc(*)IMI/?i W/S  :x€S''i  =  x  +  *^-i(*>/(«)  and  l  e  (°. D 

If    T]0f30K  =  ho  <  1/3,    then  xo  is  an  approximate  root. 

PROOF  By  hypothesis  xi  is  well  defined.  Let  Hi(x0,  Xi)  =  Hi  =  fLi(xo)f'(xi)  = 
/  —  f'-i{xo)(f'(xo)  —  f'(xi)).  Hi  maps  E  into  itself.  Our  hypotheses  imply  that 
\\f'_i(xo)(f'(xo)  —  /'(xi))||  <  ho  <  1/3,  whence  Hi  has  an  inverse.  We  have  the  estimate 
IKJJi)-1!!  =  (1  -  ho)-1  <  3/2.  Also  \\Hi\\  <  4/3.  Observe  that  f'(x0)Hi  =  f'(Xl)  and 
(#i)-1/-i(xo)  =  f'_i(xi).  Thus  f'_i(xi)  exists  and  x2  is  well  defined. 

Let  ft  =  \\f'_i(xi)\\  and  m  =  \\Xl  -  x2\\.  Thus  ft  -  \\fUMW  <  1-5  ||/li(*o)||. 
Let  Fi  be  defined  by  the  formula  Fi(x)  =  x  —  f'_1(xo)f(x).  Since  Fi(x0)  =  xi  and 
Fi(ari)  =  a;i  -  /ii(x0)/(si), 

/li(*o)/(*i)  =  Fi(*o)-iJi(*i). 
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REMARK  1.1  Assume  the  hypotheses  of  the  theorem  with  suitable  changes  in  S  and  S' . 
Take  ho    <    1/2.  Then  Xo  is  an  approximate  root. 

REMARK  1.2  The  theorem  does  not  require  the  continuity  of  /'.  Let  f(x)  =  4x,  if 
oo  <  x  <  1  and  f(x)  =  6x  -2,  if  x  >  1.  Then  every  point  is  an  approximate  root  for 
f.  For  example  let  xo  =  100.  Then  ho    —  1/3,  x\    —    1/3,  h\  —  0,  and  x2    =    0. 

REMARK  1.3  Let  S,  S'  and  K  be  defined  as  above.  Assume  that  /'  is  Lipschitz  continuous 
with  constant  L  on  S.  Let  hk  =  sup{||/!_1(xjt)(/'(x0)  —  /'(Oil  ■  x  E  S'  and  £  =  x^  + 
tf'_i(xk)f(xk)it  E  (0,1)}.  Assume  the  Kantorovich  inequality  holds.  Then  hk  <  flkVkL  < 
1/3  .  Whence  hk/  fl^k  =  K  <  L  .  We  have  replaced  L  by  K.  Another  hypothesis  to  ensure 
the  boundedness  of  K  (which  we've  assumed  outright)  is  to  require  that  /'  be  bounded  on 
S'  and,  for  any  root  x*  of  f  there  is  a  neighborhood  N(x*)  e  such  that  /'  is  Lipschitz 
continuous  on  N(x*)fl5'. 

REMARK  1.4  The  Kantorovich  type  theorems  are  important  for  the  insight  they  furnish, 
but  in  general  are  not  helpful  in  concrete  instances.  For  example,  the  above  theorem  and 
the  original  Kantorovich  theorem  are  dependent  upon  the  knowledge  of  the  constant  K  or 
L,  but  the  determination  of  upper  bounds  for  these  quantities  is  not  trivial.  Moreover  the 
conditions  given  by  these  inequalities  is  sufficient  but  not  in  general  necessary  for  a  point 
to  be  an  approximate  root.  Thus  the  determination  of  approximate  roots  is  usually  not 
practical  with  these  theorems.  Using  the  rough  estimates  furnished  by  local  application  of 
the  modified  Kantorovich  inequality  we  propose  proceeding  by  trial. 

DEFINITION  1.5  Given  e    >    0,    let    n    be  the  smallest  integer  such  that 

"©"(ST  <  - 

A  point  x0  is  an  e- approximate  root  for  the  mapping  f  if  the  Newton  sequence  {x,} 
starting  at  xo  is  well  denned  for  i=l,2,...,  n,  and 

ll/(*n)H      <     e 

ll/(*o)|| 

For  example  if  e  =  10-18  then  n  =  7.  This  test  follows  from  the  estimates  I  and  II  of  the 
above  theorem. 


LEMMA  2.0    Let  A  be  a  positive  definite  matrix.  Let  n  be  its  least  eigenvalue  and  A  its 
greatest.  Let  Q  =  A//u.  Then: 


[Ax,x]  _2_    _Q_ 

—     ^1 


11^*1111*11   ~  Q*  W  +  i) 

The  bound  is  the  best  possible. 

PROOF.  Assume  A  has  been  diagonalized,  and  let 

[Ax,x]/fi   =   x\  +  c2x\+,...,cnx2n. 

We  seek  to  minimize  f(x)  =  (x\  +  c2x2+,  ...,c4x4)/(xj  -f  4X\  =,...,04X4)2,  subject  to 
||x||  =  1.  The  reason  for  restricting  to  polynomials  of  degree  4  in  x2  will  become  apparent 
in  what  follows. 

Set  x\  =  1  —  x\  —  x\  —  x\.  Using  this  equation  to  eliminate  x\  we  get: 

1  +  (c2  -  l)x\  +  (c3  -  l)x2  +  (c4  -  l)x\ 


f(x)  = 


2\i 


(1  +  (4  -  l)x\  +  (cj  -  l)x2  +  (CJ  -  l)x2)* 


Let  P  denote  the  numerator  of  the  above  fraction  and  Q*   the  denominator.    Let  x  = 
( X7,  ^3)  *^4/  anci 

A   =   (c2  -  1,  c3  -  1,  c4  -  1) 

and 

b  =  (4-i,  4-1,  c\-i) 

The  components  of  the  equation  V/(x)    =    0  may  be  written  as  : 

x2(c2  -  1)[2B  -  (c2  +  1)A,  x)    =   x2{cc  -  l)(c2  -  1)         (a) 

x3(c3  -  1){2B  -  (c3  +  1)A,  x]    =   x3(c3  -  l)(c3  -  1)         (6) 
X4(C4-1)[2B-(C4  +  1)A,  x]    =    x4(c4  -  l)2  (c) 

If  we  assume  distinct  eigenvalues  and  that  x2,    x3  and  x4  are  non-zero  we  may  cancel 
appropriately  and  obtain  from  (a),  (b),  and  (c),  a  system  of  3  linear  equations  of  rank  2, 
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since  the  rows  of  the  system  are  linear  combinations  of  A  and  B.  Thus  one  unknown  say  x2 
or  £3  (but  not  £4  )  may  be  set  to  0.  Similarly  if  we  had  n  variables  only  one  variable  among 
x2  and  £n-i  would  be  non-zero.  If  we  set  x2  =  0,  then  the  following  system  obtains: 

(c\  -  \)x\   +   (c4  -  l)(c4  -  c3)x\    =   c3  -  1 

(4  -  l)xj   +   (cj  -  l)x\    =   c4  -  1 


One  finds  that 


2  __  (C!-1)(C4-C3)  .    n 

4-    _(C3_1)(C3+1)(C4_1)(C4_C3) 


Since  £4  is  negative,  it  is  inadmissible.  Thus  x\  must  also  vanish.  Suppose  now  that  £3  = 
0  but  £2    7^  0.  We  again  get  x\    <  0.  Thus  for  these  cases  we  must  set  x2  and  £3  to  0. 

If  C2  >  1  and  c4  >  c2  then  the  rank  of  {A,B}  =  2  This  case  is  treated  just  as  the  case 
above  of  distinct  roots.  If  all  the  eigenvalues  are  equal,  the  ratio  in  the  statement  of  the 
lemma  is  1,  verifying  the  claim  for  that  case.  For  all  other  cases  the  rank  of  {A,  B}  =  1, 
and  we  may  set  £2  and  £3  to  0. 

There  remains  to  carry  out  the  minimization.  The  equation 

(c\  —  l)x\  =  c4  —  1  implies  £4  = 


Q  +  l 


am 


f(x)    = 


2-2- 


Algorithm  3.0 

Let  f  be  a  twice  differentiable  function  defined  on  real  euclidean  space  En.  Assume  that 
f  is  convex  and  that  it  has  bounded  level  sets.  Given  an  arbitrary  point  xq  let  S  denote 
the  level  set  {x  €  Rn  :  /(£)  <  /(£o)}.  Assume  that  the  hessian  of  f  at  x,  which  we  call 
H(x),  has  an  inverse  at  £0,  denoted  by  H~1(xq).  At  the  kth  step  of  the  algorithm  assume 
that  H~1(xk)  exists.  Let 

f(x)-f(x-1H-\x)Vf(x)) 

^    '7J  7[^-1(^)V/(£),  V/(£)j 
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since  the  rows  of  the  system  are  linear  combinations  of  A  and  B.  Thus  one  unknown  say  x2 
or  £3  (but  not  X4  )  may  be  set  to  0.  Similarly  if  we  had  n  variables  only  one  variable  among 
x2  and  xn_i  would  be  non-zero.  If  we  set  x2  =  0,  then  the  following  system  obtains: 

(c\-\)x\    +   (c4  -  l)(c4  -  cz)x\    =   C3-I 

(4  -  l)x\     +     {c\  -  l)x\     =     C4  -  1 

One  finds  that 

2  __  (CJ-1)(C4-C3) 

4  -(C3-1)(C3+1)(C4-1)(C4-C3) 

Since  a:2  is  negative,  it  is  inadmissible.  Thus  x\  must  also  vanish.  Suppose  now  that  2  3  = 
0  but  x2    7^  0.  We  again  get  x\    <  0.  Thus  for  these  cases  we  must  set  x2  and  x3  to  0. 

If  c2  >  1  and  C4  >  c2  then  the  rank  of  {A,B}  =  2  This  case  is  treated  just  as  the  case 
above  of  distinct  roots.  If  all  the  eigenvalues  are  equal,  the  ratio  in  the  statement  of  the 
lemma  is  1,  verifying  the  claim  for  that  case.  For  all  other  cases  the  rank  of  {A,  B}  =  1, 
and  we  may  set  x2  and  x$  to  0. 

There  remains  to  carry  out  the  minimization.  The  equation 

{c\  —  V)x\  =  C4  —  1  implies  x\  = 

and 

f(x)    = 


Q  +  l 


Q1* 


Algorithm  3.0 

Let  f  be  a  twice  differentiate  function  defined  on  real  euclidean  space  En.  Assume  that 
f  is  convex  and  that  it  has  bounded  level  sets.  Given  an  arbitrary  point  x0  let  S  denote 
the  level  set  {x  G  Rn  '■  f{x)  <  f(xo)}-  Assume  that  the  hessian  of  f  at  x,  which  we  call 
H(x),  has  an  inverse  at  x0,  denoted  by  H~1(x0).  At  the  kth  step  of  the  algorithm  assume 
that  H~1(xie)  exists.  Let 

f(x)-f(x-1H-\x)Vf(x)) 


g{x,i)  = 


7[^-1(^)V/(x),  Vf(x)] 
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Choose  8  G   (0,1/2]  and  choose  7*    >   0  so  that  6   <  g{xk,~fk)   <   1  —  6,  taking  7*  =  1, 

if  possible.    Set  Xk+i  =  Xk  —  Jk  H~1(xk)  Vf(xk).    Let  S'  =  {xk  G  S  :  k  =  1,2,3, }. 

Assume  that  the  spectrum  of  H(x)  is  bounded  above  on  S'  by   AQ,  and  below  by  A.  Let 

h  =  sup^WH-^xXHix)  -  H(S))\\  :xeS'  and  £  =  x  +  tH'\x)Vf(x),  t  G  [0, 1]}. 


(a)  Assume  that  K  = 

Let  N  be  the  least  integer  exceeding: 


f(x0)-minf  S2A3 

where         A  = 


A  (l  +  2hQ1'2)K2Q1/2 

Then  an  approximate  root  of  V/(x)  will  be  achieved  in  at  most  N  steps. 

(b)  Let 

62(1-S)2A3 


A1== 


(l  +  2hQ2  K2Q* 
.  Let  M  be  the  least  integer  exceeding: 

/(go)  -  minf 
min{A,A!} 

.  Then  in  at  most  M  steps  an  approximate  root  will  be  achieved,  and  all  subseqent  steps 
will  be  Newton  steps. 

PROOF  (a)  Assume  in  what  follows  that     x     E  S.    The  change  in     f    do  to  the  step 
7s(x)    =   jH _1(x)  V/(z)  may  be  estimated  by  Taylor's  formula  as: 


(*)  A(ar)  = /(*)-/(* -7  *(*))  =  7 


i_1_1[s(x),(H(0-H(x))s(x)} 


[Vf(x),s(x)\ 


2       2  [Vf(x),s(x)} 

or 

(**)  A(x)    =    7^(x,7)[V/(x),5(a:)] 

Here  £  lies  between  x  and  x  -  75(1).    By  the  above  formula  we  see  that  the  right  hand 
limit  of  g(x,y)  at  7  =  0  is  1.  Since  S  is  bounded,  for  some  7,  g(x,-y)  =  0.  This  shows  that 
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7  may  be  chosen  as  claimed.   We  see  also  that  {/(x*)}  is  a  decreasing  sequence  so  that 
Xk  E  S  for  k=l,2,3, 

We  aim  now  to  find  a  lower  bound  for  A(x).    In  the  equation  (*)  above,  the  third  term  in 
the  large  brackets  is 

jy\\Vf(x)\\\\H-\x)(H(x)  -  H(0\\  \\s(x)\\ 


2  [Vf(x),H-i(x)Vf(x)] 

Using  lemma  2.0  we  get  the  inequalities 

Where  h(x)  =  sup  { ||/f-1(ar)( ^(x)  -  H(£)\\  :  £  =  x  +  ts(x)  un*/i  <  6  [0, 1]}.  and: 

0  +  1 

so  that  .5  <  a  <  1.  Since  #(x,7)  <  1  —  <!>  we  thus  obtain  the  lower  bound 

2£ 


7    > 


1  +a/i(x)Q2 


If  {||V/(xjt)||}  does  not  converge  to  0,  an  infinite  subsequence  of  it  is  bounded  away  from 
0.  Since  [V/(x),  s(x)]  >  ||V/(x)||2/QA,  and  1kg{xk,~fk)  is  also  bounded  away  from  0, 
/(xjfc)  tends  to  —00.  This  contradiction  establishes  that  the  sequence  (V/(x/;)}  converges 
to  0.  Moreover  every  cluster  point  of  the  set  S'  minimizes  f,  and  {/(x*)}  converges  to 
min  f. 

If  x  does  not  satisfy  our  condition  for  an  approximate  root  then  ||i/"-1(x)||  ||s(x)||  K  > 
1/2.  By  the  lemma  [V/(x), s(x)]  >  (g1/2a)-1||s(x)||  ||V/(ar)||.  Consequently,  ||s(x)||  > 
l/2ii:||JJ-1(ar)||>  and  ||V/(x)||  ||s(x)||    >    1/4A'2A3.    Thus  a  lower  estimate  of  (**)  is 

S2 

A(x)   >    ° r   =   A 

~    {l  +  2hQ24A3K2Q> 

We  may  similarly  find  a  number  of  steps  that  will  guarantee  that  an  approximate  root  has 
been  reached  and  that  the  above  algorithm  will  always  produce  subsequent  Newton  steps. 
We  do  this  by  observing  that  .5/1  ^(xJHAaQ1/2  <    .5  -  6  implies  that  .bKh{x)aQl>2    < 
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.5  —  8.  And  this  implies  that  8  <  g(x,  1)  <  1—8.  Thus  we  shall  count  the  steps  for 
which  ||s(zjfc)||  exceeds  (1  -  28)/aKAQ1/2.  As  above  we  find  that 

82(.5-8)2A3 

A(x)   >   * r1 5-   =  Ai 

~    (l  +  2hQ*  K2Ql 

We  now  "count"  the  steps.  Since  A(xjt)  is  bounded  away  from  zero,  say  by  A,  we  have 
f(x0)-f(xk)>   fc(j  Eto^.))  >   kA.  Set 

=    f(x0)-minf 
A 

Set 

_  f(x0)-minf 

mm(A,  Aj} 
If  k    =    N,  and  Xk  is  not  an  approximate  root,  we  have  a  contradiction. 

REMARK  3.1  The  results  above  are  disappointing  in  that  the  cost  of  the  algorithm  is 
sensitive  to  the  condition  number  Q,  in  spite  of  the  fact  that  Newton  directions  are  taken. 
(Recall  that  Smale's  global  Newton  method  was  not  sensitive  to  the  condition  number). 
Indeed  the  gradient  method  is  less  sensitive  to  Q  than  this  method.  We  may  classify  this 
algorithm  as  "greedy"  because  it  is  trying  to  decrease  f  at  each  iteration.  On  the  plus  side, 
the  algorithm  is  easily  implemented. 

The  most  robust  result  over  the  class  of  strongly  convex  functions  is  due  to  Nesterov.  A 
simple,  easily  coded  algorithm  using  combinations  of  gradient  steps  will  drive  f(xn)/ f(xo) 
to  less  than  e  in  less  than 

\§ln{i)steps 

.  By  the  theory  of  Nemerovsky  and  Yuden,  for  some  positive  number  c  no  algorithm 
can  do  better  than  the  following  number  of  steps  for  every  strongly  convex  function  of 

condition  number  Q: 

min(n,  y/Q)     ,    1 

c- — t=-  In-. 

mmzn(n,vQ)       e 

For  the  case  when  n  >  y/Q  we  can  assert  that  Nesterov's  method  is  to  within  a  slowly 
changing  multiplicative  factor  essentially  optimal  over  the  class  of  strongly  convex  func- 
tions. This  method  and  its  generalizations  are  being  studied  by  Osman  Guler  at  U.  of 
Chicago,  School  of  Business. 
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Consider  the  Smale  global  Newton  method  applied  to  minimizing  strongly  convex  functions 
of  condition  number  Q.  This  method  which  is  sensitive  to  a  Lipschitz  constant  for  the 
Hessian  would  not  be  a  candidate  for  optimality  on  the  set  of  strongly  convex  functions. 
The  reason  is  that  there  exist  strongly  convex  functions  with  condition  number  Q  that  have 
Hessians  with  arbitrarily  large  Lipschitz  constants.  However  for  the  multitude  of  natural 
problems  with  bounded  Lipschitz  2nd  derivatives,  or  bounded  values  of  the  constant  K, 
we  should  expect  better  results  for  large  condition  numbers  from  the  Smale  global  Newton 
method,  than  with  an  algorithm  of  the  Nesterov  type. 
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We  now  digress  to  the  problem  of  linear  inequalities.  Let  A  be  an  m  by  n  matrix  of  rank 
n,  and  b  an  m  by  1  matrix.  Denote  the  ith  row  of  A  by  A1.  Set 

R(x)  =  Ax  —  b. 

We  seek  a  solution  of  the  system  of  inequalities  : 

Rt(x)    <    0         1  =  l,2,...,m. 

Or,  if  this  system  has  no  solution,  to  establish  its  inconsistency.  Let  G(x)  =  max{Ri(x)  : 
1  <  i  <  m}.  We  assume  that  G  is  bounded  below,  and  consequently,  that  G  has  bounded 
level  sets.  To  ensure  that  this  is  the  case,  a  phony  half-space  may  be  added  to  our  system  of 
inequalities.  Let  Aq  =  —  ^,=1  At.  Let  Rq(x)  =  [A0,x}  —  b.  Let  G*(x)  =  max{Rt(x)  :  0  < 
i  <  m}].  Let  z(b)  =  argmin  G*.  If  the  original  system  is  consistent  then  for  b  sufficiently 
large  G(z(b))<  0. 

We  shall  employ  the  penalty  function: 

m 

^[max(0,  Ri(x))]p         withp>   2 

We  note  that  for  p  >  2  ,  F  is  convex.  If  p=2,  F'  is  continuous,  and  F"  has  jump 
discontinuities.  If  p  >  3  then  F'"  is  continuous.  Our  numerical  experiments  using  F  to 
solve  inequalities  gave  most  satisfactory  results  with  p=2,  even  though  more  smoothness 
is  obtained  with  larger  values  of  p.  Thus  in  what  follows  we  shall  take  p=2.  We  assume 
that  F  has  bounded  level  sets. 

Let  I~*~(x)  denote  the  set  of  all  indices  from  {1,2,3,  ...,m}  for  which  Ri(x)  >  0  when 
i  £  I+(x).  If  dim{Ai  :  i  €  I+(x)}  <  n,  then  F"(x)  does  not  have  an  inverse.  We  seek  the 
following  construction. 

CONSTRUCTION  B  4.0 

Assume  that  at  x^  the  dimension  of  the  set  of  gradients  of  the  actice  residuals  is  less  than 
n.  That  is,  dim  {At  :  I  <  i  <  q}  <  n  Take  h  ^  0  such  that  [Al,h]  =  0,  1  <  i  <  q. 
Let  efc  =  .5(F(xfc-i  -  F(xk).  Find  the  smallest  t  such  that  J2iRKx  +th)  :  q  +  1  <i  < 
m  and  R±  >  0}  =  e\/2{m  —  q)  Set  x^i  =  xk  +  th.  Repeat  this  process  if  necessary.  After 
at  most  m-q  steps  we  obtain  Xk+i- 
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ALGORITHM  5.0  Take  x0  arbitrarily  in  En.  If  dim{Ai  :  i  G  I+{xo)}  <  n  use  (4.0) 
to  find  x\  with  dim{Ai  G  I+(xi)}  =  n.  At  the  kth  iteration  we  are  given  Xk  and  a 
non-singular  H(xk).  Choose  7*  such  that  .75  >  g(xk,jk)  >  -25,  taking  7*  =  1,  if  possible. 
Set  Xk+i  =  Xk  —  ■jkH~l(xk)Vf(x).  If  H  has  an  inverse  at  Xk+i  then  set  Xk+i  =  Xk+i 
Otherwise  update  Xk=i  with  the  construction  (4.0)  or  (4.1)  to  obtain  zjt+i. 

CLAIM  5.1  Assume  the  hypotheses  of  (4.0).  The  algorithm  is  well  defined  and  will 
terminate  in  a  finite  number  of  steps,  with  a  positive  value  of  F  if  the  system  is  inconsistent 
and  with  F  =  0  if  the  system  is  consistent.  For  the  latter  case  the  argument  of  F  is  a 
solution  of  the  inequalities. 

PROOF  Let  X  =  {x  G  En  :  [A\x]  <  &;,  1  <  i  <  m}.  Assume  that  X  is  not  empty. 
Let  w  denote  the  number  of  vertices  of  the  solution  set  X,  and  let  v3  ,  s=l,2,...,w  denote 
the  vertices.  Each  v3  lies  in  the  intersection  of  at  least  n  hyperplanes  supporting  X. 
Any  point  in  X  is  on  the  right  side  (Ri(x)  <  0)  of  these  hyperplanes.  Stated  otherwise: 
[A\vs]  =  bi,  i  G  h,  cardls  >  n.  Let  C(v3)  =  {x  G  En  :  \A\x)  >  bt,i  G  I3)  =  {x  G  En  : 
\A\x  —  vs]  >  0,i  G  Ia},and  let  C(v3)  denote  its  closure.  Let  B3  be  a  ball  of  radius  r3 
centered  at  v3.  If  some  hyperplane  [A1,  x]  —  bi  such  that  i  G  /  ~  I3  meets  C(v3)  then  there 
exists  a  minimal  value  of  r3  such  that  B3  C\  C(v3)  meets  the  closest  hyperplane  [A1,  x]  —  bt 
such  that  i  G  /  ~  I3.  Points  in  B3  D  C(s)  ~  {v3}  are  on  the  wrong  side  of  the  same 
hyperplanes,  n  or  more  in  number.  In  all  the  above  sets  s  is  understood  to  range  over 
l,2,...,w. 

It  follows  from  the  proof  of  (3.0)  that  the  above  algorithm  generates  a  sequence  {xk}  G  S 
(the  level  set  of  F  at  xo  )  such  that  F(xk)  converges  downward  to  min  F.  We  claim 
that  the  only  cluster  points  of  {xk}  are  the  vertices  vs,  s  =  1,2,  ...,ty.  The  sets  I+(xk) 
are  collections  of  n  or  more  out  of  m  indices  that  are  repeated  infinitely  often.  Thus  at 
least  one  of  the  collections  must  be  frequently  repeated.  Let  {xjt, }  denote  a  subsequence 
converging  to  a  limit  v.  Take  a  thinner  subsequence  if  necessary  such  that  only  one  index 
set  is  represented.  Since  F(v)  =  0,  it  folows  that  v  £  X.  Since  {xki }  is  on  the  wrong  side 
of  at  least  n  hyperplanes  at  points  arbitrarily  close  to  X,  the  index  set  I  must  be  one  of  the 
sets  7a,  s=l,2,...,w.  Let  k  denote  the  least  value  of  k  such  that  xj.  G  B3  D  C(s)  for  some 
s  =l,2,...,w.  At  most  one  more  step  at  xj.  terminates  the  process,  because  a  Newton  step 
minimizes  the  restriction  of  F  to  B3  PI  C(v3)  -a  quadratic  function,-  in  one  step. 
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Assume  now  that  X  is  empty.  A  necessary  condition  that  a  system  of  inequalities  be 
inconsistent  is  that  0  belongs  to  the  convex  hull  of  the  rows  of  the  matrix  A.  Let  x* 
minimize  F.  We  claim  that  x*  is  unique,  card  I+  (x*)  >  n  +  1,  and  0  belongs  to  the  convex 
hull  of  the  rows  of  A.  If  card  I~*~(x*)  <  n  choose  h  so  that  [A\  h]  =  — 1,  i  6  I+(x*).  Then 
for  some  h  sufficiently  small  F(x*)  can  be  decreased.  Since  x*  is  a  strict  local  minimum 
it  is  unique  because  of  the  convexity  of  F. 

Let  B  be  a  ball  centered  at  x*  with  the  property  that  I+(x)  =  I+(x*)  for  all  x  6  B.  This 
existence  of  such  a  ball  follows  from  the  continuity  of  Ri(x)  for  each  i,  1  <  i  <  m,  and 
because  R{(x*)  ^  0  for  all  i  6  J+(x*).  Because  x*  is  unique  the  sequence  {x*}  converges 
to  it.  Thus  for  some  least  k  =  k  x~k  £  B.  Thus  the  solution  occurs  here  or  at  the  next 
step. 

Notice  that  the  parameter  K  of  (3.0)  is  actually  finite.  Consider  the  denominator  of  K 
for  k=0,l,2,...,fc.  Since  ||s(x)||  >  ||V/(x)||/Q£  the  denominator  is  always  positive.  (If 
V/(x)  =  0  we  have  a  solution)  One  more  step  at  Xf.  terminates  the  process.  The  Newton 
step  minimizes  the  quadratic  function  (restriction  of  F  to  B3  C\  C(v9)  in  one  step.  Note 
that  the  numerator  of  K  for  this  last  step  is  0,  while  the  denominator  is  positive. 

NUMERICAL  COMPUTATIONS  6.0 

The  Blair  example  may  be  found  in  Kortanek  and  Shi.  The  coefficients  for  the  case  n=8 
are  written  out  (Example  2a,  p55)  and  a  program  is  given  to  generate  the  coefficients  for 
any  n.  For  n  =  12,  the  case  for  which  we  offer  extensive  calculations,  the  Blair  problem  is 
a  linear  programming  problem  (LP)  of  the  form:  minimize  L(x)  subject  to 

Ri(x)  <  0  1  <  i  <  24 

of  which  12  inequalities  constrain  x  to  lie  in  the  first  orthant.  The  coefficients  of  the 
system  are  integers  between  1  and  305,175,780.  Thus  the  system  is  very  poorly  conditioned. 
The  problem  has  a  unique  solution  Xi  =  0,  i=l,2,...,ll,  x\2  =  1,  with  L(x)  =  305175780. 
The  system  we  solve  contains  following  inequalities  : 

r,(x)  <  0,         i  =  1,2,  ...,25         where 

r14(x)  =  L(x)  -  305175780, 
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rl(x)  =  Ri(x),  i  =  l,13         and 

rt+l(x)  =  Rt(x)         i  =  14,  ...24 

Superlindo  required  2438  iterations  to  solve  the  above  LP  problem  with  full  accuracy.  Be- 
cause one  cannot  enter  linear  inequalities  directly  into  Superlindo  we  entered  the  following 
problem:  min  L(x)  subject  to 

ri(x)  <  0         1  <  i  <  25. 

Thus  when  phase  I  was  finished  the  problem  would  terminate.  This  took  2236  iterations. 
Let 

r(x)  =  Ax  —  b. 

The  components  of  A  and  b  are  listed  at  the  end  of  this  section. 

A  simple  scheme  of  row  scaling  was  used  to  convert  to  a  better  scaled  problem.  Let  bm 
be  the  maximal  component  of  the  right  hand  side.  bm=305175780.  The  scaled  system  is: 

(bm/\bi\)rt(x)<0         i=  1,2,3,  ...,14 

bmri(x)<0         i  =  15,  ...,25 

Thus  4.0  should  be  used.  Some  computations  were  made  before  4.0  was  coded  using  an 
ad  hoc  procedure  of  an  overrelaxed  gradient  step  to  move  off  a  degenerate  point  x.  The 
step-length  chosen  was  100/||i7(a;)||.  This  has  worked  for  this  problem  in  at  most  3  steps 
for  every  example  (over  100)  tried.  However  the  penalty  function  usually  increases  during 
these  perturbations.  Subsequently,  the  method  of  4.0  was  coded.  The  results  were  similar 
to  those  given  below,  with  the  moves  in  the  null  spaces  (which  we  think  of  as  gear  shifts) 
replacing  the  gradient  steps. 

There  follows  15  successive  runs  with  random  initial  vectors  with  components  lying  between 
-1000  and  1000.  The  12  numbers  after  xq  are  the  components  of  the  starting  vector. 

The  last  column  contains  a  list  of  integers  in  order  1,2,3  interspersed  with  the  symbol  *. 
Each  integer  numbers  a  normal  step  of  the  algorithm  while  *  indicates  a  gradient  step. 
In  what  follows  disregard  this  last  column.  We  explain  first  the  lines  containing  tt,  info, 

17 


rmax,  number,  number,  number.  Here  tt  means  the  number  of  active  residuals;  its  value 
is  the  first  number.  Info  is  a  test  for  degeneracy;  its  value  is  the  second  number.  If  info  = 
0  the  point  is  nondegenerate,  info  =  1  ,  degenerate.  Rmax  is  the  value  of  the  maximum 
residual.  It  is  the  3rd  number. 

Now,  the  line  that  contains  step-length,  gamma,  number,  number.  Here  step-length  = 
\\H~1(x)Vf(x)\\.  Its  value  is  the  first  number.  The  meaning  of  gamma  is  that  of  algorithm 
3.0,  the  fraction  of  a  Newton  step.  The  value  of  gamma  is  the  second  number.  At  the 
bottom  of  the  page  we  have  x,r  number,number.  This  the  row- wise  print  out  of  the  solution 
vector  followed  by  the  residuals  at  solution. 
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AFFENDIX    THE  COMPONENTS  OF  THE  BLA I R  MATRICES 
FIFTEEN  RUNS  WITH  RANDOM  STARTING  POINTS 


a 

(  1  , 

1  )  = 

-5. 

a 

(2, 

1  )  = 

-1  . 

a 

(  3 , 

1  )  = 

0. 

a 

( 4 , 

1  )  = 

0 . 

3 

(5, 

1  j  = 

0. 

a  (  6 , 

1  )  = 

0. 

a 

I  7, 

1  )  = 

L)  . 

a 

(8, 

1  )  = 

0. 

a 

(  9, 

1  .)  = 

0. 

a 

C  10 

,  1  ) 

=  0. 

a 

(  1  1 

,  1  ) 

=  0.  0 

a 

(  12 

,  1  ) 

=  0. 

a 

i  13 

,  1  ) 

=  0 .  0 

a 

(  la 

.  1  ) 

=  c 

a 

C  15 

,  1  ) 

=  - 1 

a 

<  IS 

,  i  > 

=  0 . 

a 

C  17 

.  i  ) 

-  0 . 

a 

C  1  s 

,  I  j 

=  0 . 

a 

i  19 

,  l ) 

=  0. 

a 

(20 

,  l ) 

=  G  . 

a 

(21 

,  l ) 

=  0. 

a 

(  42 

,  l ) 

=  0 . 

a 

(23 

.  l ) 

—  i_i  , 

a 

(24 

,  l ) 

=  G . 

a 

(25 

,  l ) 

=  0. 

a 

(  1  , 

2  >  - 

-10. 

a 

v.  2 , 

2 )  = 

_  c 

a 

(3, 

2  )  = 

-1 . 

a 

(  4  . 

2  .'  = 

0. 

a 

(5. 

2)  = 

0 

a 

(6, 

2 )  = 

0. 

a 

/  —f 

2)  = 

0. 

a  (  S, 

2)  = 

0. 

a 

C9, 

2)  = 

0. 

a 

(  10 

.  2.) 

=  0 . 

a 

(  11 

.  2) 

=  0. 

a 

(  12 

,  2  ) 

=  u . 

a 

(  13 

,2) 

=  0. 

a 

C  la 

.  2; 

=  30. 

a 

(  15 

.  2) 

=  0. 

a 

^  16 

,  2) 

=  - 1 . 

a 

(  17 

,  2) 

=  0. 

a 

(  13 

.  2  > 

=  0. 

a 

(  19 

,  2  ) 

=  0. 

a  (20 

'1  \ 

=  0. 

a 

(21 

.  2) 

=  0 . 

a 

(  22 

,  2) 

=  0 . 

a 

(23 

,  2) 

=  0. 

a 

v24 

.  2  ) 

=  0. 

a 

(25 

,  2) 

=  0. 

a 

(  1  . 

3)  = 

-20. 

a 

(2, 

3;  = 

-  10. 

a 

(3, 

3)  = 

_  c 

a 

(a. 

3)  = 

-1 . 

a 

(5, 

3  )  = 

0. 

a 

(6. 

3)  = 

0. 

a  (  7,3) 
a  ( 6,  3  ) 
a  (  9 .  3  ) 

a  (  10.  Jr 
a  (  1  1  .  3 
a ( 12. 3 
a  (  1  3  .  5 
a  (  1  4  ,  3 
a  (  15  ,  3 
a ( 16 , 3 
a  (  1  7  ,  3 
a( 13, 3 
a ( 19, 3 
a  (  2  0  ,  3 
a  (  21  ,  3 
a(22, 3 
a  (  ^  0  ,  J 
a  (  2  4 ,  3 
a  (  2  5  ,  3 
a  (  1  ,  a  ) 
a  (  2  ,  a  > 
a  (  3  ,  4  ; 

dU,  4  ) 

a(5. 4) 

a  (  6  ,  4  ) 
a  (  7  ,  4  ) 
a (3. 4 ) 
a  (  9  ,  4  ) 
a ( 10, a 
a(  1  1  ,  4 
ai 12, 4 
a ( 13, 4 
a ( 1 4, 4 
a( 15, 4 
a ( 16 , 4 
a( 17. 4 
a ( 13, 4 
a  (  1 9  .  4 
a ( 20 , 4 
a ( 21  . 4 
a ( 22 , 4 
a ( 2d , 4 
a  (  24  ,  4 
a ( 25 , 4 
a( 1. 5) 
a(2,  5 
a  (  3,  5 
a(4,  5 
a  (  5  ,  5  .i 
a  (  6  ,  5  .) 
a  (  7  .  5  > 
a(3, 5; 
a ( 9, 5  ) 
a ( 10. 5 
a(  11  ,  5 
a ( 12, 5 
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=  0. 

=  0. 
=  0. 
)  =0. 
;  =0. 
)  =0. 
)  =0. 
) =155, 

>  -  0 . 
)  =  0 . 

)=-l. 

)  =0. 
;  =0. 
)  =0. 
)  =0. 
)  =  0 . 

>  =0. 
.i  =  0 . 
)  =  0 . 

=  -40. 
=  -20. 
=  -10. 

-  _  c 

—  z>  • 

=  - 1 . 

=  0. 
=  0. 
=  0. 
=  0. 
)  =0. 
)  =0. 
)  =0. 
)  =0. 
)  =730 
)  =0. 
)  =0. 
)  =0. 

)  =-1 . 

)  =0. 
;  =0. 
)  =0. 
)  =0. 
)  =0. 
)  -0 . 
)  =0. 
=  -30. 
=  -40. 

=  -10. 
=  -5. 
=  -1. 
=  0 . 
=  0. 
=  0. 
)  =0. 
)  =0. 
)  =0. 


a  i  1  o  ,  o  > 

-  0  . 

a  ( 1 4 ,  5  ) 

=3905 . 

a  *  15.5) 

=  0. 

a  v 16 , 5  ) 

=  0 . 

a ( 17, 5 ) 

=  0. 

a ( 18, 5 ) 

=  0 . 

a ( 19, 5 ) 

=  -1 . 

a ( 20 , 5  ; 

—  \J   • 

a (21 . 5 ) 

=  0. 

a  C  22 , 5  J 

—  u  > 

a  ».  ^3  ,  5  ) 

=  0. 

a (24. 5) 

=  0 . 

a (25, 5) 

=  0. 

a  (  1  ,  6  )  = 

-  160. 

a ( 2, 6  )  = 

-30. 

a  (  3  ,  6  J  = 

-40. 

a ( 4, 6  )  = 

-20. 

a  (  5  ,  6  i  = 

-10. 

a  (  6  ,  6  j  = 

-5. 

a ( 7, 6  )  = 

-1  . 

a  (  8,  6  )  = 

G . 

a (9, 6 ) = 

0 . 

a  (  1  G  ,  6  ) 

=  0. 

a  (  1 1 ,  6  ) 

=  0  . 

a( 12, 6; 

=  0. 

a  (  1  3  ,  6  ) 

=  0 . 

a( 14, 6) 

=  1  9530 

a  i.  1  5  ,  6  .) 

=  0. 

ai 16, 6; 

=  0. 

a ( 17, 6 ; 

=  G . 

a ( 18, 6 ) 

=  0 . 

a  (  1 9  ,  6  ) 

=  0 . 

a ( 20 . 6  j 

=  -1  . 

a  ( 2 1 ,  6  ) 

=  0 . 

a ( 22 , 6  j 

=  0. 

a ( 23 , 6 ; 

=  0 . 

a ( 24 . 6 ) 

=  G . 

a (25, S ) 

=  0 . 

a( 1 , 7) = 

-  d>  ^_  (j  . 

a  (  2  ,  7  j  - 

-160. 

a  (  3  ,  7  >  - 

-60. 

a  (  a, 7  )  = 

—  •*  w  . 

a  C 5, 7  ;  = 

-2G  . 

a  (  6  ,  7  )  = 

-  10. 

a  (  7  ,  7  )  = 

-5. 

a  ( 8 ,  7 )  = 

-  1  . 

a (9 , 7 ) = 

0. 

a ( 10 , 7  > 

=  0. 

a  (  1  1  ,  7  ) 

=  \J  . 

a  (  1 2 ,  7  ) 

=  'J  . 

a  *.  13.  7  ) 

=  0 . 

a  ( 1 4 ,  7  ) 

=97655 

a  (  1 5 ,  7 ) 

=  0  . 

a ( 16, 7 ) 

=  0  . 

a  v  1  7  ,  7  > 

=  0  . 

a ( 16 , 7 ) 

=  0 . 

a  i.  1 9 ,  7  ; 
a  v  i_  o  ,  /  ; 
a  (  2 1  •  i  ! 
d  e  *.  *-  <  /  ; 
aii.o,  7 ) 
a( 24, 7) 
a  (  25.  7; 
a  ( 1 ,  8 )  = 
a  (  2 ,  8  )  = 
a  ^  3  ,  8  ;  = 
a  (  4,  8 )  - 
a  *.  3  ,  8  ;  = 
a  (  6  •  8 )  = 
a  (  7 ,  8 )  = 
a  i.  3  ,  3  )  = 
a (9, 8) = 
a  ( 1 0 ,  8 ) 
a  C  1  1  .  8  ; 
a  1 1 2 ,  8  ) 
a( 13, 8) 
a  ( 1 4 ,  8  ) 
a  ( 1 5 ,  8 ) 
a  <  1 8 ,  8 ) 
a( 17, 8) 
a  (  1  3  ,  8  ) 
a( 19, 8) 
a  (  2  0 ,  8 ) 
a(21, 8; 
a ( 22, 3 ) 
a  (  23  ,  8  ; 
a  v  i.4  ,  8 ) 
a(25, 8) 
a  ( 1 , 9)  = 
a (2, 9 ) = 
a  i.  3  ,  9  ;  = 
a ( 4, 9  )  = 
a  1 5 ,  9  )  = 
a  ( 6 ,  9  )  = 
a  v  7  ,  9  ;  = 
a  ( 8 ,  9  )  = 
a  ( 9 ,  9  )  = 
a  (  10  .  3  ; 
a  c 11, 9) 
a  v  1  2  ,  9  ) 
a  ( 1 3 ,  9  ) 
a  v  1  4  .  9  ; 
al 15, 9 ) 
a  C 16, 9) 
a( 17. 9) 
a  ( 1 8 ,  9  ) 
a  (  1 9  ,  9  ) 
a ( 20 , 9 ; 
a  i.  2  1  ,  3  ; 
a  (  2  2 ,  j  ; 
a  ■.  2  3  ,  9  ) 


=  -1. 

=  0. 
=  0. 
=  0. 
=  0  . 
-640. 
-320. 
-ISO. 
-30. 
-40 . 

-  _0  . 

- 10. 
-5  . 

-  1  . 
=  o . 
=  0. 
=  0 . 
=  0. 

=488280. 
=  0. 

=  0  . 
=  0. 
=  0. 
=  0. 
=  0. 
=  0. 

=  -i. 

=  0. 
=  0 . 
=  0. 

-  1280. 
-640. 
-320. 
-160. 
-80. 
-40. 
-20 . 
-10. 
-5 

=  -1. 
=  0. 
=  -1  . 
=  0 . 

=2441405 

=  0. 
=  0. 
=  0. 
=  0. 

=  0. 

=  0. 
=  0. 
=  -1.0 


a  c 


9 ;  =0 


ai<.b,  j  ,'  = 

-j . 

a  (  1 ,  1  0  j  = 

-2560. 

a  ( 2 ,  10;  = 

-  1 230 . 

a  c 3,  10)  = 

_b40  . 

a ( 4 , 10 )  = 

-  3  2  0  . 

a  C 5 ,  10)  = 

-160. 

a  ( 6 ,  10;  = 

-60. 

a (7.  10;  = 

-40 . 

a  C  3 ,  10;  = 

-20. 

a(9, 10 ) = 

-10. 

a  ( 10, 10; 

-  _  c 

a( 1 1 , 10; 

=  -1  . 

a  v  1  2 ,  10; 

=  0  . 

at  13, 10) 

=  0. 

a ( 14, 10 ; 

=  1  j_^0  7030 

a ( 1 5 , 10) 

=  0. 

ai 16, 10) 

-  \J  . 

a ( 17, 10 ) 

=  0. 

a (  13.  10  ; 

=  0  . 

a  t 1 9 ,  10) 

=  0 . 

a ( 20 ,10) 

=  0. 

a (21 . 10 ; 

=  0. 

a  i  2  2  ,  10) 

=  0. 

a  C  23,  10 ) 

=  0. 

a  C 24,  10 ; 

=  -1 . 

a  t 25 ,  10 ; 

=  0 . 

a  (  1  .  1  1  ;  = 

-5 120. 

a(2,  11  )  = 

-2560 . 

a(3, 11)  = 

-1230. 

a (4.  11)  = 

-64O . 

a^S,  11;  = 

ai6.  11;  = 

-160. 

a ( 7 ,  11)  = 

-60. 

a(6, 11;= 

-40  . 

a ( 9 , ll;= 

-20 . 

a ( 10 .  11; 

=  -10. 

a ( 1 1 ,  11; 

-  _  c 

ai 12,  11  ; 

=  -1 . 

a ( 1 3 ,  11; 

=  0 . 

a( 14, 11 ) 

=61035155 

a( 15,  11; 

=  0 . 

a( 16.  11  ) 

=  0. 

a( 17,  1 1  ; 

=  0 . 

a( 18,  11  ) 

=  0. 

a  ( 1 9 ,  11; 

=  0  . 

a(20, 11) 

=  0. 

a(21,  11; 

=  0. 

a(22,  1  1  ; 

=  0. 

a  ( 2.3.   11; 

=  0. 

a  (  2  4  ,  1 1  ; 

=  0. 

a i 25,  11) 

=  -1. 

a  C  1  ,  1  z_  ;  = 

-  10240. 

a  *.  2  ,  12;  = 

-5120. 

a ( 3 , 12;= 

-  2560 . 

a  (  4 ,  1  2  ;  = 

-1280. 

a ( 5 , 12 ) = 

-  6-+0 . 

a  v  b  ,  1 

_  ;  = 

-  3  ^  U  . 

a  ( 7 ,  1 

2 )  = 

-Idu. 

a  1  8  ,  1 

2  ;  = 

-30. 

a  (9,  1 

2  )  = 

-  40  . 

al  10, 

12) 

=  -20. 

a(  1  1  . 

12; 

=  -  10. 

a(  12, 

12) 

=  -5. 

a  (  13. 

12) 

=  -1  . 

al  14, 

12) 

=  3051 

a  C  15, 

12) 

=  0. 

at  16. 

12) 

=  0 . 

at  17, 

12) 

=  O . 

ai  13, 

12; 

=  0. 

a  (  1 9  , 

12) 

=  0. 

a  *.20, 

12; 

=  0 . 

a  ( 21 , 

12) 

=  0. 

a  ( 22 , 

12) 

=  0 . 

a  (  23 , 

12) 

=  0. 

a  e  24 , 

12; 

=  0. 

a  (25, 

12) 

=  0. 

bll)  = 

-u096. 

b(2)  = 

- ^043 . 

b(3)  = 

-10 

24 . 

b  t  4  )  = 

-51 

.L . 

bc5)  = 

—  dL 

56. 

b<6)  = 

-12 

8. 

b(7)  = 

-64 

. 

b(3)  = 

—  Cj  *- 

. 

b(9)  = 

-16 

. 

b  l  10; 

=  -8 

. 

be  1  1  ) 

=  -4 

. 

b(  12; 

—  _  r' 

. 

b  (.  13  ; 

=  -1 

. 

b  (  1  4  ) 

=  30 

c  1  — c  — 

w/  J.  /  --1     1 

be  15; 

=  0. 

b  (  16  ) 

=  O . 

be  17) 

=  0. 

b  (  18) 

=  0 . 

be  19) 

=  0. 

b  ( 20.) 

=  0. 

b(21 ) 

=  0. 

b(22) 

=  0  . 

b(23) 

=  0. 

b  (24) 

=  0. 

b  <.  25  ; 

=  0. 

73^ 
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RUN  #1   li  Newton  steps  and   a   gradient  steps 
xO 


-  157. 299626709990 

5  07. 770637071353 

-677. 746807236177 

83a .  63522102312a 


-743, 322103336538 
531. 201493434374 

-361.  13350-6071757 
563.  4129-49712823 


-971. 379266S917! 

39  J.  5aj4o  j65u4ij1 
425. 52051615  3176 
268.  5373a823  7653 


1 1 .  info,  r m  a  x , 
1 1 ,  info,  rmax, 


7. 00000000000000 
14. 0000000000000 


1     236624527029.611   * 
1     9653257644971.96   * 


steplength, gamma     47765.5239230591 
1 1 ,  info,  r  max ,      1 4 . 0000000000000 


1 . 00000000000000 

0     2357700197.06733 


steplength,  gamma     19.25»'56alld0305 
1 1 ,  i  i"i  r  o  ,  i  max  ,      12  .  0000000000000 


1  . 00000000000000 

0     242829520a. 71995 


steplength, gamma     5454. 13223736253 
tt,  iiuu,  r  max  ,      la.  0000000000000 


0. 305175781250000D-00 

0     2a28221033. 03133 


steplength,  gamma      17.  d7u5077615^ay 
t  t ,  info,  r ma  x ,      12. 0000000000000 


1 . 00000000000000 

0      1185139263.73383 


steplength, gamma     5472. 94705380250 
tt, info, rmax,      13. 0000000000000 


0. 762939453125000D-00 

0      1185130226.83878 


1 1 ,  into,  r  max , 
1 1 ,  info,  rmax, 


1  . 00000000000000 
19. 0000000000000 


1     620675031 . 14548    * 
1      163062230969.794   * 


steplength, gamma 
1 1 ,  info,  rmax. 


138. 732501363430 
13. 0000000000000 


1. 00000000000000 

0      153611533.072391 


steplength, gamma 
t  t ,  info,  rmax. 


196. 752514409908 
14. 0000000000000 


0. 152587890625000D-00 

0      153610594.233101 


steplength, gamma 
1 1 ,  info,  rmax, 


66. 3907250047904 
13. 0000000000000 


0. 107421675000000D-001 

0      15234838a . 537403 


a 


steplength, gamma 
1 1 ,  info,  rmax, 


63. 3248672145210 
16. 0000000000000 


0. 13183S937500000D-G01 

0      152548504. a2115G 


steplength, gamma 
tt, info, rmax. 


0. 584973381718277 
12. 0000000000000 


1 . 00000000000000 

0      133329412.561193 
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steplength, gamma 
1 1 ,  info,  rmax. 


0. 504481166507457 
12. 0000000000000 


1. 00000000000000 
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0 


0.250339508056641D-005 


steplength, gamma    0. 9  36594908882337D-0 14 
1 1 .  i  nf o .  r max ,      12. 0000000000000 


1 . 00000000000000 

0    0. 000000000000000 


.  r     0. 165629975217302D-031    0.60859386242636 

6D-031 

0. 1 756a48109261 16D- 

-030 

0. 412919380076623D- 

-030 

0. 850490663441403D- 

-050 

0. 173795918181504D- 

-029 

0. 345126646034193D- 

-029 

0. 690253292068385D- 

-023 

0. 136078506150625D- 

-028 

0. 26821270 77 75144D- 

-028 

0. 544314024602498D- 

-028 

1 . 00000000000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-45776366a. 000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-a5776366a. 000000 

-457763664. 000000 

-457763664. 000000 

0. 000000000000000 

0. 000000000000000 

-0. 505a62562l58010D- 

-023 

-0. 185728104234804D- 

-022 

-0.5 3602 5al475 36 100- 

-022 

-0. 126012992240322D- 

-021 

-0.2595a9148196485D- 

-021 

-0. 530383041966730D- 

■021 

-0.  105324292021762D- 

-020 

-0. 21 06a856a0a3524D- 

-020 

-0. 415273637 lla376D- 

-020 

-0. 818520212283408D- 

-020 

-0. 1661 1 1454845750D- 

-019 

?1 


RUN    ttZ 


[j e w  t  o  n    s  t  S  p 3    ■=>  n >:' 


a  r  a  d  i  >9  n  t    steps 


xu 


tt 
tt 
tt 


-930. 292890085242 
244. 623299272343 
508. 377056980336 
416. 323740083475 


-863. 6^422/490599 
713. 519969562319 
-  162. 246891100147 

-708. 495647012945 


info,  fitiax, 
i  n  r  o  ,  rmax, 
i  n  t  o  ,  rmax. 


3. 00000000000000 
1 . 00000000000000 
16. 0000000000000 


-322. 317913607336 
543. 254998043461 
618. 7319664^2102 
253. 088220713413 
283902854639.046   * 
1371116230676.87   * 
359774939814244.    * 


steplength, gamma     435728. 1725395. 
tt, info, r max,      12. 0000000000000 


1 . 00000000000000 

0     161170658. 157925 


steplength, gamma 
1 1 ,  info,  r  max. 


10514.  ?1265665S7 
14. 0000000003000 


0. 274653203125000D-003 

0      161126391.314559 


steplength, gamma     60.4510944932947 

1 1 ,  info,  r max ,      14. 0000000000000 


0. 312500000000000D-001 

0     156091441. 193965 


steplength, gamma     52. 55045770067/3 
tt, info, r max,      15.0000000000000 


0. 125000000000000 

0      148358483.404517 


steplength, gamma     126. 08^75634^685 
tt , int o, rmax ,      14.0000000000000 


0. 644531250000000D-001 

0     147307230.642514 


steplength, gamma    0. 649075995843773 
tt, into, rmax,      12.0000000000000 


1. 00000000000000 

0     12955577^ 


393379 


steplength, gamma    0. 490203091522860 
tt, info, rmax,      12. 0000000000030 


1. 00000000000000 

0    0. 244379043579102D-0C 


steplength, gamma    0.9131 138868539 10D -01 4 
tt, into, rmax,      12. 0000000000000 


1 . 00000000000000 

0    0.000000000000000 


0. 

0. 

0. 

1 

-4 

-a 

-  4- 

"4 

-0. 

-0 . 

-0. 

-0. 

r      0. 3312599504 
2002967 1421 6273D- 
1 6 763294235 946 5D - 
134 106 3538875 72D- 
. 00000000000000 
57763664. 000000 
57763664. 000000 
57763664. 000000 
57763664. 000000 
101092512431602D- 
1 25 072596 7  75 342D - 
10306 734 290701 0D - 
806<+83 150338064D- 


34605D-031 


0. 100148357108136D-030 


030 
029 
028 


022 

-0 

021 

-0 

020 

-0 

020 

-0 

0. 409837892165604D- 
0. 337731075047746D- 
0. 264268403249039D- 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
3056285 259 56006D - 
250 145 19355 1635 D - 
2076393 18557 188D - 
16 129663006  761 3D - 


030 
029 
028 


022 

-0 

021 

-0 

020 

-0 

019 

0. 819675784331207D-0I 

0. 6303925307531230-0^ 
0. 528536806498078D-0; 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 

61 125705 19 12012D-0; 
51 15751 32677 130D-0: 
409260106 141 7040-01 
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RUN 


i     Newton  steps  and  i   gradient  step 


xO     084 . 636 1360a03. 
390.  55636^-074000 
323. 399904502448 
-9-4-.  6  125941835709 


521 . 53299147395 
22. 5991 136970037 
825. 563592993691 
•4-66.  486448786907 


1 1 ,  info,  i  max 


17. 0000000000000 


-700. 0580836401' 

-639.  5694-22^39330 

996. 3a01 13297574 

-450. 87885423801* 

529467259301 . 064 


step  length,  g  a  m  m  < 
1 1 ,  info,  iiiidX, 


2212. 27366031213 
14. 0000000000000 


1 . 00000000000000 

0      194736857.815711 


steplength, gamma 
1 1 ,  into,  r  ■  m  a  x , 


11 . 5597435264857 
15. 0000000000000 


0. 937500000000000D-001 

0      179212381.151034 


steplength, gamma 
1 1 ,  info,  1 m  a  x , 


17.  al0072b<4-79677 
15. 0000000000000 


0. 312500000000000D-001 

0      173957713.602083 


steplength, gamma 
1 1 ,  info,  1 m  a  x , 


13. 1910259009825 
16. 0000000000000 


0. 109375000000000 

0     156186399.016667 


steplength, gamma 
1 1 ,  info,  t  m  a  x , 


-4.  33788792^13538 
17. 0000000000000 


0. 375000000000000 

0     126699425.005. 


steplength, gamma 
1 1 ,  info, f  m a  x , 


0. 65480^890885739 
12. 0000000000000 


1 . 00000000000000 

0  1341  1  1089.  5<+63. 


steplength, gamma 
1 1 ,  info,  1 m  a  x , 


0. 507437943699474 
12. 0000000000000 


1 . 00000000000000  7 

0    0. 250339508056641D-005 


steplength, gamma    0 . 9367969824 180 18D-014 
tt, info, r max,      12. 0000000000000 


00000000000000 

0    0.000000000000000 


,  r     0. 13096323621833; 

0. 140207699951391D-030 

0. 173795918181504D-029 

0. 138050658413677D-028 
1. 00000000000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 
-0. 399668072404008D-023 
-0. 113787851202082D-021 
-0. 105324292021762D-020 
-0. 818520212283u0SD-020 


D- 

031    0.485 

0 

. 3728600372 

0 

. 3a51266460 

0 

. 2682127077 

457763664. 0 

45776366a. 0 

457763664. 0 

457763664 . 0 

0 

. 0000000000 

-0 

. 1481 122856 

-0 

. 2595491481 

-  \J 

. 2106485840 

-0 

.  1661  1  I45a6 

334345935583 

33369D-030 

34193D-029 

75144D-023 

00000 

00000 

00000 

00000 

00000 

55603D-022 

96485D-021 

43524D-020 

45750D-019 


D-031 

0. 850490663 

0. 690253292 

0. 544314024 

-457763664. 

-457763664. 

-457763664. 

-457763664 . 

0. 000000000 

-0. 427879936 

-0. 530383041 

-0. 421297168 


441^03D- 

068385D- 

602493D 

000000 

000000 

000000 

000000 

000000 

338408D 

966730D- 

087048D- 


030 
029 

028 


021 

020 
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RUN  *■ 


N  B  W  t  O  l"i   S  t  &  P  s 


xo 


-  i   J*..  JUiiO, 


341 

262 
966 


271154817054 
673709250306 
6214-03447874 


741  .  53660<45295" 
324. 279857033038 
60a. 307441254551 
-693. 073 136470057 


244. 383834286300 
1 12. 1 13379925655 


-321 
-623 


;886549000 


141231 


/  5  d  di  7  0 


1 1 ,  into,  rmax, 


uUOuOUUOOUOOO 


1096. 


'396623. 85 


steplength, gamma     2002. 30968276938 
tt, info, rmax,     13. 0000000000000 


1 . 00000000000000 

0      153540383. 712843 


steplength, gamma     130. 062162441505 
tt,  Info,  rmax,      14. 0000000000000 


0. 634765625000000D-002 

0      153117350.272783 


steplength, gamma     29.8103139169651 
tt,  info, rmax,      15. 0000000000000 


0. 253906250000000D-001 

0     151769052.907618 


steplength, gamma     7.61286793105905 
tt, i nf o, rmax ,      16. 0000000000000 


9375 000 00000000D- 001 

0      149354307.834918 


steplength, gamma    0. 4807975  75295 140 
1 1 ,  into,  rmax ,      12. 0000000000000 


1. 00000000000000 
0     13332941 


581193 


steplength, gamma    0. 504481 166507457 
1 1 ,  info,  rmax ,      12. 0000000000000 


1 . 00000000000000 

0    0. 244379043579102D-0 


steplength, gamma 
1 1 ,  info,  i max. 


0.918104743739594D- 
1 . 00000000000000 


014 


00000000000000 

1    0. 596046447753906D-0 


,  r  0.770371977 
0.  208000433993821D 
0. 202145606962884D 
0. 163015730011275D 

1. 00000000000002 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 235093366120005D 


75489 
-031 
-029 
-027 


■0 
■G 


-Ui.4 

2936735526500060-022 

-020 
018 


275361690229J_5oD' 
2426671688 181uOD- 


4D-03 

0.  9 

0.  9 

0.  7 

-45 

-45 

-45 

-45 

0.5 

-0.  1 

-0.  1 

-0.  1 

-0.  1 


3  0.4333342374 
6 296 497219 36 18D- 
1 70508023 19426D- 

95171792462780D- 
7763664. 000000 
7763664. 000000 
7763664. 000000 
7763664. 000000 
9604644775 3906D- 
32243112192503D- 
3447655 1420643D- 
25135 444231580D- 


03229843243, 


:D- 


87128D-032 

031 

0. 4406527 

029 

0. 4102076 

027 

0. 3382635 

-45776366 

-45776366 

-45776366 

-45776366 

007 

-0. 5960464 

023 

-0. 6347669 

021 

-0. 6168994 

019 

-0. 5585196 

017 

71275300D-0 
70714926D-0 
56158770D-0. 
4. 000000 
4. 000000 
4. 000000 
4. 000000 
47753906D-0' 
38524012D-0 
24698892D-0 
74263973 D-0 
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RUN  »5 


Newton  steps 


xO    -114.147717656216 
624.  46  16624-19657 
1*8.  7877S42G91593 

-427.  420645454674 


556.  470022662264 
-654. 960097720481 
6  75. 66066001 1940 
-607. 602961981098 


-490. 0392433191 73 
-156. 588812026271 
297. 942673453505 
-603. 144542622476 


1 1 ,  info,  i  in  a  x  , 


19. 0000000000000 


762403473253. 473 


step  length,  gamma     1696. 80530559346 
tt, info, r m ax,      13. 0000000000000 


00000000000000 

0      194664482.932851 


steplength, gamma 

1 1 ,  i  n  f  o  ,  j."  m  a  x  ,      15 


78. 7277480487342 
0000000000000 


0.  122070312500000D-003 

0      194642039.668371 


steplength, gamma     10. 53012452574; 
1 1 ,  i  nf o.  i max,      16 . 0000000000000 


0. 125000000000000 

0      171746426.699385 


steplength, gamma 
tt,info,rmax,      16 


8. 22887713006761 
0000000000000 


0. 156250000000000D-001 

0      169258335.804595 


steplength, gamma 
1 1 ,  info,  i m  a  x , 


18 


4. 40534461134. 
0000000000000 


11 


0. 312500000000000 

0     125667764 


'8846 


steplength, gamma 
1 1 ,  info,  i  ni  a  x  , 


0. 637037230856529 
12. 0000000000000 


1 . 00000000000000 

0      134638584.393735 


steplength, gamma 
1 1 ,  info,  i  m  a  x , 


0. 509430809427019 
12. 0000000000000 


1 . 00000000000000  7 

0    0. 2503395080566410-005 


steplength, gamma 
1 1 ,  i  n  f  o  ,  r  m  a  x  ,      1 . 


0. 936  74580055 189  3D-0 14 

:. ooooooooooooo 


1 . 00000000000000 

0    0.000000000000000 


,  r     0.  108815041857879 
0.  1  17866912596499D-030 
0. 173795918181504D-029 
0. 13305065S413677D-028 

1. 00000000000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
■0. 332077148394506D-023 
■0. 9497994191 248 19D- 022 
•0. 106828924764930D-020 
■0. 818520212283408D-020 


D-031    0. 

0. 3112302 

0. 3500570 

0. 2682127 

-45776366 

-45776366 

-45776366 

-45776366 

0. 0000000 

-0. 1210759 

-0. 2332180 

-0. 2136578 

-0. 16611 14 

39674156854377 

79012977D-030 

26691824D-029 

07775144D-028 

4. 000000 

4. 000000 

4. 000000 

4. 000000 

00000000 

16051802D-022 

75191045D-021 

49529860D-020 

54845750D-019 


1D-031 

0. 76420900 

0. 70011405 

0. 54431402 

-457763664 

-457763664 

-457763664 

-457763664 

0. 00000000 

-0. 35970126 

-0. 53038304 

-0. 42129716 


1932355D- 

-030 

3383648D- 

-029 

4602498D- 

-  028 

. 000000 

. 000000 

. 000000 

. 000000 

0000000 

5  163607D- 

-022 

1966730D- 

-021 

30870480- 

-020 
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RUN  #6 


Newton  steps  end  2  gradient  steps 


xO     472. 3610796810a8 
899. 660706261435 
64. 0326036041202 
955 . 4  77280014122 


-831 . 00367800543' 
814.  735alG2385a8 
-59. 8063268680018 
640. 367128 180124 


-740. 935969423671 
-652. 488692051^25 
72. 9986403563025 
712. 535229961250 


1 1 ,  info,  i max , 
1 1 ,  info,  t m  a  x , 


5. 00000000000000 
16 . 0000000000000 


1      26808381 1943. 665 
1     23715049130988.6 


step  length,  gamma 
tt, info, r max,     1 


50637. 997Z940535 
0000000000000 


1 . 00000000000000 

0     161169141 


15365  1 


steplength,  gamma     10514.  71^663611:=* 
tt, info, r max ,      14. 0000000000000 


0. 274658203125000D-003 

0     161124874.726943 


steplength, gamma     60. 45 10874755542 
1 1 ,  info,  r  max ,      14. 0000000000000 


0. 312500000000000D-001 

0     156089971.999712 


steplength, gamma     52. 5504645937000 
tt . info, r max ,      15. 0000000000000 


0. 125000000000000 

0      148358479.963610 


steplength. gamma     126. 089752134237 
tt, info, i max,      la. 0000000000000 


0. 64453 1250000000D- 001 

0      147307227.42806  1 


steplength, gamma    0.649075033909147 
tt, info, fmax ,      12. 0000000000000 


1 . 00000000000000 

0     129555772.393379 


steplength, gamma    0. 490203091522860 
tt, info, r max,      12. 0000000000000 


1 . 00000000000000 

0    0. 244379043579102D- 


stepl en gth, gamma    0.91 19245a65071 79D-G 1 4 
tt , i nf o, i max ,      12. 0000000000000 


1 . 00000000000000 

0    0.000000000000000 


,  r     0.331259950434605 
0.  200296714216273D-030 
0. 167632942359465D-029 
0. 134106353887572D-028 

1 . 00000000000000 
-457763664. 000000 
-45776366a. 000000 
-a 5 776 3 66a.  000000 
-a5776366a. 000000 
-0  .  10  10925 12a3l6G2D-022 
-0. 12al322G131 1362D-021 
-0. i0l56271G1636a2D-G20 
-0. 80648315033806aD-020 


D-031    0.98607613152626 
0. 406756404254584D-030 
0. 3328006943901 14D-029 
0. 264268403249039D-028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 300926548633606D-022 
-0. 250145193551685D-021 
-0. 20a630053070852D-020 
-0. 1588892176785440-019 


5D-031 

0. 819675784331207D- 
0. 670531769437860D- 
0. 520648197445368D- 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-45776366a. 000000 
0. 000000000000000 
-0. 61 125705 19 1201 2D- 
-0.51 15751326771 30 D- 
-0. 409260106141 70 4D- 
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RUN   #7 


8  Newton  steps 


xO    -980.614385562064 
872. 092335185815 
-787. 4233S3854608 
-801 . 412660064975 


754. 663860379469 
903. 372305432807 
-889. 882406466205 
-257. 581608353113 


-849. 966118423708 
903. 822716644623 
-656. 189370753424 
-733. 888854017488 


tt, info, rmax. 


20. 0000000000000 


0 


930810709180. 125 


steplength, gamma 
1 1 ,  info,  rmax. 


2781. 62252337554 
12. 0000000000000 


1 . 00000000000000 

0      153611829.496706 


steplength, gamma 
1 1 ,  info,  rmax , 


3648. 13836926195 
15. 0000000000000 


0. 3910064697265630-004 

0     153605823. 174790 


steplength, gamma 
tt, info, rmax, 


64. 0782140937533 
16. 0000000000000 


0. 830078125000000D-002 

0     153096180.228943 


steplength,  gamma 
1 1 ,  info, rmax , 


27.6115425905722 
15. 0000000000000 


0. 195312500000000D-001 

0     152568067.708317 


steplength, gamma 
1 1 ,  info, rmax , 


73. 2258353230729 
15 . 0000000000000 


0. 305175781250000D-004 

0      152567395.728954 


steplength,  gamma 
tt, info, rmax. 


0. 340599172069112 
12. 0000000000000 


1.00000000000000 

0      132047268.790020 


steplength, gamma 
t t , info, rmax , 


0. 499630146021219 
12. 0000000000000 


1.00000000000000  7 

0    0. 250339508056641D-005 


steplength, gamma 
1 1 ,  info, r ma  x , 


0. 934835255493608D-014 
12. 0000000000000 


1. 00000000000000 

0    0.000000000000000 


8 


,  r  0.215704153 
0. 206459690038312D 
0. 168865537523873D 
0. 136078506150625D 

1. 00000000000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-0. 658276825 13601 3D 

-0. 126012992240322D 

-0. 104571975650178D 

-0. 818520212283408D 


771370D-031 


0. 80118685686509 


-030 
-029 
-028 


-023 

-0 

-021 

-0 

-020 

-0 

-020 

-0 

0. 412919380076623D-030 
0. 342661455705377D-029 
0.26821 2707775 144D-028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 

244502820764805D-022 
257668357267525D-021 
20763931 8557 188D- 020 
163704042456682D-019 


OD-031 

0. 844327687619364D-030 
0. 680392530753123D-029 
0. 536425415550288D-028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 63006496 120 161 2D- 022 
-0. 515336714535050D-021 
-0. 4152786371 14376D-020 
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RUN   #8 


9  Newton  steps 


xO     489.859138456204 
174. 179628824158 
425. 973625697280 
955. 040074874622 


20.9052331088909 
653. 211700218227 
171. 141846780673 
896. 536088135900 


1 1 ,  info,  rmax , 

steplength, gamma 
1 1 , info, rmax , 


18. 0000000000000 

2023. 42010222668 
12. 0000000000000 


-633. 600054840564 
675. 884989041090 
-754. 508656207635 
206. 621797933154 

273601096408. 878 


steplength, gamma     15612. 1105994219 

tt, info, rmax,  14.0000000000000 

steplength, gamma     23.5758796432499 

tt, info, rmax,  16.0000000000000 

steplength, gamma     18.9507539629753 

tt, info, rmax,  15.0000000000000 


steplength, gamma 
t t , info, rmax , 

steplength, gamma 
t t , info, rmax , 

steplength, gamma 
t t , info, rmax , 


34. 1524046774300 
16.0000000000000 

92. 0011728271753 
14. 0000000000000 

0.213780894549538 
12. 0000000000000 


steplength, gamma    0. 490203091522860 
tt, info, rmax,      12.0000000000000 


steplength, gamma 
t t , info, rmax ,      1 


0. 895106789666395D-014 
00000000000000 


1.00000000000000  1 

0     159079979.545477 

0. 190734863281250D-005        2 
0      159079676. 124495 

0. 781250000000000D-002       3 
0     158553666.463820 

0. 125000000000000  4 

0     154534990.248806 

0. 244140625000000D-003       5 
0     154529135. 198641 

0. 280761718750000D-001        6 
0     153934008. 178371 

1.00000000000000  7 

0     129555772.393379 

1.00000000000000  8 

0  0. 238418579101563D-0C 

1.00000000000000  9 

1  0. 596046447753906D-0C 


0. 776390508831104D-033 


0. 4333342374871 


0. 206074504049434D-031 
0. 204610797291700D-029 
0. 183015730011275D-027 

1 . 00000000000002 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
■0. 236935576011567D-024 
■0. 293873582650006D-022 
■0. 279861690229253D-020 
■0. 242667 1688 18 140D-0 18 


0.9629649721 936 18D-031 
0. 917050802319426D-029 
0. 795171792462780D-027 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 5960464477539060-007 
■0. 132243112192503D-023 
■0. 136357342349603D-021 
0. 125185444231580D-019 
■0. 104770587172276D-017 


28D-032 

0. 446815747097839D-0 

0. 410207670714926D-05 

0. 343312265952184D-02 

-457763664. 000000 

-457763664.000000 

-457763664. 000000 

-457763664. 000000 

-0. 596046447753906D-0C 

-0.62888946687 10 12D-02 

-0. 624422588414732D-02 

-0. 558519674263973D-01 
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RUN   #9 


10  Newton  steps  and  2  gradient  step 


xO 


tt 
tt 


-854. 972506153810 
-675. 078848947569 
-795. 176371801571 
-jab.  7 S 2 4 6  i  m-  5  u ._  3  4 


-983. 769175140755 
924. 3034  13741492 
-0. 500703910808475 


. 616508754233 


into,  rmax, 
info,  iiiiax, 


7. 30000000000000 
15. 0000000000000 


447. 07590106966. 
38. 9442774086471 
467. 150834676203 
721 . 51 1348799489 

300222521-428.  460 
i 7359 1 03d508 70 . 1 


steplength, gamma     540z7 . d046 ly008^ 
tt, into, rmax,      12.0000000000000 


1 . 00000000000000 

0     1786211071.36421 


steplength.  gamma     15776.  56286t)4350 
1 1 ,  into,  r  max  ,      14  .  0000000000000 


0. 316619873046875D-003 

0      176564-5521.44  156 


steplength, gamma 
1 1 ,  info,  rmax. 


2/  . 7719Z44099574 
14. 0000000000000 


0. 250000000000000 

0     1339236345.33143 


steplength, gamma     8. 49827918067834 
tt, info, rmax,      12. 0000000000000 


1 . 00000000000000 

0     590430919.304070 


steplength, gamma     2736 . 52420367105 
tt, into, rmax,      13. 0000000000000 


0. 7629394531250000-005 

0     590426415.173640 


steplength, gamma     47. 6924304507833 
tt ,  i  nf o,  r max ,      la. 0000000000000 


0. 78125000000000GD-002 

0     585835967.15553. 


steplength, gamma     8. 13685607249363 
1 1 ,  into,  rmax  ,      15.  0000000000000 


0. 625000000000000D-001 

0     549466999.076904 


steplength, gamma     42. 5352574148447 
tt, Info, rmax,     16. 0000000000000 


0. 328125000000000 

0     370527291 


6  5  3912 


steplength, gamma 
1 1 ,  Info,  rmax , 


1. 55797420666023 
12. 0000000000000 


1  . 00000000000000 

0      133329412 


561 193 


steplength, gamma    0. 504481 166507457 
tt, Info, rmax,      12. 0000000000000 


00000000000000  10 

0    0.2503395080566410-005 


steplength, gamma    0 . 93637729656047 1D-014     1.00000000000000 
tt. info, rmax,      12.0000000000000  0    0.000000000000000 

x  ,  r     0. 165629975217302D-031    0 . 597038282760043D-031 


0.  175644810928116D-030 
0. 173795918181504D-029 
0. 133050658413677D-028 

1. 00000000000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 505 46 256215 60 10D-023 
-0. 128834178633763D-021 
-0. 104571975650178D-020 
-0. 618520212283408D-020 


0. 422163843809682D-030 
0. 342661455705377D-029 
0. 2682 1 2 707775 144D- 028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
■0. 162201621243004D-022 
■0. 257668357267525D-021 
•0.210643564043524D-020 
•0. 1661 1 1454845750D-019 


0. 84432 763 76 19 36 4D-030 
0 . 690253292068365D-029 
0.  5443140246024-980-023 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
0. 536025414755610D-022 
0.530383041 9 66730D-021 
0.  4^129716d087'j48D-0lc0 
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RUN   #10 


7  Newton  steps 


xO     168.562088607904 
-215. 631795284871 
-312. 386754660958 
-783. 756813578536 


879. 936512051979 
386. 541205751119 
-847. 804830474609 
-462. 177283109723 


t t , info, rmax , 

step  length, gamma 
1 1 , info, rmax, 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info, rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info, rmax , 

steplength, gamma 
1 1 ,  info, rmax , 


18.0000000000000 

1935. 29079830120 
12. 0000000000000 

7019. 68685306682 
14. 0000000000000 

78. 7484599706272 
13. 0000000000000 

335.697096172363 
14. 0000000000000 

3. 57321680138793 
12. 0000000000000 

0. 490203091522860 
12. 0000000000000 

0. 913177239355039D-014 
12. 0000000000000 


282. 756764008947 
-272.694289835621 
-918. 030969523965 
318. 376253985250 

280160813516. 508 


1.00000000000000  1 

0     851810879.278383 

0. 122070312500000D-003       2 
0     851706898.458158 

0. 781250000000000D-001        3 
0     785166074.844281 

0. 209960937500000D-001        4 
0     768681659.969552 

1.00000000000000  5 

0     129555772.393379 

1.00000000000000  6 

0    0. 244379043579102D-0 

1.00000000000000  7 

0    0.000000000000000 


,  r     0.32548216060144 
0. 200296714216273D-030 
0. 167632942359465D-029 
0. 134106353887572D-028 

1  .  00000000000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 993292709357019D-023 
-0. 125072596775842D-021 
-0. 101562710163842D-020 
-0. 806483150338064D-020 


3D-031    0.98607613152626 
0. 409837892165604D-030 
0. 332800694390114D-029 
0. 264268403249039D-028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0 . 000000000000000 
-0. 300926548633606D-022 
- 0.250 1451 9355 1685D-021 
-0. 207639318557188D-020 
-0. 161296630067613D-019 


5D-031 

0. 8 19675 78433 1207D-0 
0. 680392530753123D-0 
0. 528536806498078D-0 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0.61 125705 19 12012D-0 
-0. 51 1575 132677 130D-0 
-0. 409260106141704D-0 
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RUN   #11  10  Newton  steps  and  2  (gradient  step 

xO    -507.462338260756  -745.331526294334  822.626989288406 

460.053375018011  -77.6^30245133148  -<+06  .  98  1  993993563 

-554.  3a5688116258  -506.4273^9605299  53.2199324551-891 

-905.916211360387  -92^.250809940743  901.741966752070 

tt, inf o, rmax,      9.00000000000000  1     282058958142.296   * 

tt ,  inf  o,  f  max ,      14.0000000000000  i     96784031  ^+9694 .  32   * 

stepl ength, gamma     45364.5042318625  1.00000000000000  1 

t  t  ,  i  nf  o ,  r  max  ,      12.0000000000000  0     ^29 1 07069 .  64 1  <+63 

step  1  ength,  gamma     15773.5499860498  0 . 748634338378906D-004       2 

tt.into.rniax.      14.0000000000000  0     42907a9a5 .  2 1 2750 

step  1 ength.  gamma     29.2671518584511  0 . 625000000000000D-001        3 

t t. inf o, rmax,      14.0000000000000  0     4022588a3 . 2 734 16 

step  1 ength,  gamma     10.3875006835552  0.375000000000000  4 

tt,  Info, rmax,      18.0000000000000  0     295236784.148774 

step  1 ength,  gamma     2.4  1364909828324  1.00000000000000  5 

tt . i nf o, rmax ,      13.0000000000000  0     287724616.031283 

step  1 ength,  gamma     106.889816604460  0 . 244 1 40625000000D-003       6 

tt, inf o, rmax ,      16.0000000000000  0     287655027.217895 

stepl ength, gamma     9.48881403921367  0 . 156250000000000D-00 1        7 

tt,  inf  o,  rmax,      18.0000000000000  0     283221899.6635-43 

step  1 ength,  gamma     11.5704315204349  0.  156250000000000D-001        8 

tt, inf o, rmax,      19.0000000000000  0     278861295.0276^5 

step  1 ength,  gamma    0.911987664675868  1.00000000000000  9 

tt, inf o, rmax,      12.0000000000000  0     135022355.063402 

stepiength, gamma    0.510872132671297  1.00000000000000  10 

tt, inf o, rmax,      12.0000000000000  0    0 .  2503395080566'+ 1 D-005 

stepl ength. gamma    0 . 935628649287364D-01 4     1.00000000000000 

tt, inf o, rmax,      12.0000000000000                  0  0.000000000000000 
x  ,  r      0. 938890847888777D-032    0 . 3370377402677660-03 1 

0. 100143357108136D-030    0 . 2634672 16392 1 74D-030  0 . 65943841 2956 139D-030 

0. 156539585879795D-029    0 . 35005702669 1824D-029  0 . 700 1 1 4053383643D-029 

0. 138050658413677D-028    0 . 2682 1 2707775 1 44D-028  0 . 5364254 1 5550233D-028 

1.00000000000000          -457763664.000000  -457763664.000000 

-45776366m-.  000000          -457763664.000000  -457763664.000000 

-^+5776366^.000000          -457763664.000000  -457763664.000000 

-^+5776566'+.  000000          -  ^57763664  .  000000  -457763664.000000 

-457763664.000000          0.000000000000000  0.000000000000000 

-0. 2665267430337560-023   -0. 102855753927502D-022  -0. 305628525956006D-022 

-0.  S04G38 1221 304 16D-022   -0.2012a462939872aD-021  -0.  47772089 59 5 56-49 D- 021 

-0. 108828924764930D-020   -0. 21 365734-9529360D-020  -0. 421297 168067048D-020 
-0.  518520212283-4080-020   -0.  163704042456682D-0  1  9 
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RUN   Jti: 


10  New  ton  s  teps 


xO    -415.465089220958 
-777. 129532256195 
-976. 113784378833 
-78. 1654829784306 


93. 3967863568357 
503. 520149216688 
686. 576335880251 
169.694047289757 


1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
tt, info, rmax, 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
t t , info, rmax , 

steplength, gamma 
1 1 ,  info, rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 

steplength, gamma 
1 1 ,  info,  rmax , 


19. 0000000000000 

2075. 58548391905 
12. 0000000000000 

4. 19354626531279 
13. 0000000000000 

581. 479889666029 
14. 0000000000000 

17. 0801205817469 
17. 0000000000000 

6. 52560684331984 
15. 0000000000000 

2. 39912596957116 
15. 0000000000000 

18. 3964281018146 
19. 0000000000000 

0. 662869275097632 
12. 0000000000000 

0. 510872132671297 
12.0000000000000 


-655. 692275827660 
-632. 224189726941 
263. 850657800655 
-953. 766508610371 

669201674021. 751 


1. 00000000000000 

0     495718564. 127140 

0. 500000000000000 

0     356977880.225168 

0.61 035 1562500000D-004 

0     356957986.239844 

0. 781250000000000D-001 

0     331543988.701578 

0. 500000000000000 

0     181610652.924412 

0. 125000000000000 

0     162997667.387076 


0. 218750000000000 

0     134566511 


091070 


1.00000000000000 

0     135022355.068401 


8 


1.00000000000000  9 

0    0. 250339508056641D-0Q 


steplength, gamma    0. 938228545 189278D-014     1. 
tt, info, rmax,      12.0000000000000 
x  ,  r     0.938890847888777D-032    0.3428155301 


00000000000000 

0    0.000000000000000 
00928D-031 
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0. 100918729085891D-030 
0. 156539585879795D-029 
0. 138050658413677D-028 

1 . 00000000000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 286526743083756D-023 
-0. 81 81440540976 16D-022 
-0. 106828924764930D-020 
-0. 830557274228752D-020 
PAUSE? 


0. 268089448258703D- 
0. 350057026691824D- 
0. 272157012301249D- 
-457763664. 000000 
-457763664. 000000 
-457763664.000000   ' 
-457763664. 000000 
0. 000000000000000 
-0. 104618995423402D- 
-0. 201244629398724D- 
-0. 213657849529860D- 
-0. 166111454845750D- 


030 
029 
028 


022 

-0 

021 

-0 

020 

-0 

019 

0.65943841 2958 189D- 03 
0. 700114053383648D-02 
0. 544314024602498D-02 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 

3079795 1 46 17206D- 02 

477720895955849D-0; 

421297168087048D-0: 
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RUN  #13 


6  Newton  steps   2  gradient  step: 


xO     536.477440169505 
-565. 22135571 1304 
-60. 3906713861346 
157. 383786486445 


961  .  442495391034 
130. 182536508556 
626. 92944290951 1 

-42.  1332  745426034 


449. 092869 8874  3. 
768. 9137497  34951 
273. 2492742377 14 
528. 67166  7306334 


tt,  into,  finax, 
1 1 ,  into,  r m  a  x , 


4. 00000000000000 
15. 0000000000000 


1      191934030783 . lbo 
1      1664569109934-4.  1 


steplength, gamma     37117. 6105 9 12J37 
tt,  info,  r max,      14.  0000000000000 


00000000000000 
0     93946546' 


761931 


steplength,  gamma  11.6ylZ01204Zlvi>l 

t t , i nf o , rmax ,  14.0000000000000 


500000000000000 
0     532153539 


89560" 


steplength, gamma     21 . 0876406660046 
tt, info, rmax,      15. 0000000000000 


0. 500000000000000 

0     283305905.447369 


steplength, gamma 
1 1 ,  info,  r max , 


75. 6961499181736 
16. 0000000000000 


0. 226562500000000 

0     219586876.653159 


steplength, gamma 
1 1 ,  into,  rmax. 


1 . 446234439312: 
12. 0000000000000 


00000000000000 
0      133329412 


.31  133 


steplength, gamma 
1 1 ,  info,  rmax. 


C.  504-48116650/  457 

..  0000003000000 


1 . 00000000000000  b 

0    0 . 25033950305664 1 D- 005 


steplength, gamma 
1 1 .  info,  i max ,      1 


0.  934: 


:011646448D-014 


I. 0000000000000 


00000000000000 

0    0.000000000000000 


0.  161778115328528D-031 


0. 597038282760043D-031 


0. 174104066972606D-030 
0. 1737959181815040-029 
0. 136078506150625D-028 

1 . 00000000000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-0. 49370 76 1 88520 10D- 023 
-0. 128834178633763D-021 
-0. 104571975650178D-020 
-0. 8185202122634060-020 


0.42215  3843809682D-030 
0.  34-2661455  705377D-029 
0. 2682127077751 44D-028 
-457763664. 000000 
-45776366a. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 182201621243004D-022 
-0. 257668357267525D-021 
-0. 210643564043524D-020 
-0. 161296630067613D-019 


0.  844-3 2763 76  19 36 4D-0 30 
0. 6902532920683850-029 
0. 528536806498073D-028 

-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 531 323437431 2 10D- 022 
-0. 53038304 1 96 6 7 30 D- 021 
-0. 4152736371 14376D-020 
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RUN 


#1-+ 


6  Newton  steps   3  gradient  steps 


xO 


-did. 188277293696 
225. 308342001 151 
749. 187231293977 
21  . 6374771325915 


-74. 7127697490351 
■449. 30306  7641651 
334. 306731674327 
834. 136420883962 


1 1 ,  info,  r max , 
1 1 ,  into, r m  a  x , 
1 1 ,  info,  r  m  a  x , 

steplength, gamma 
1 1 ,  info,  r m  a  x , 

steplength, gamma 
1 1 ,  info,  rmax, 

steplength, gamma 
tt,  info, rmax, 

steplength, gamma 
1 1 ,  info,  rmax, 

steplength, gamma 
tt,  into,  rmax, 

steplength, gamma 
1 1 ,  info,  rmax , 


8.  00000000000000 
1 . 00000000000000 
17. 0000000000000 

895425.  145^+14435 
13. 0000000000000 

98. 7784435622585 
1 5 . 0000000000000 

13. 9259737920949 
14. 0000000000000 

16. 3951704458082 
15. 0000000000000 

0. 7171 126866026  73 
12. 0000000000000 

0. 499630146021219 
12. 0000000000000 


363. 859180360879 
-722.  7 21760  1277^1 
566. 136306586745 
-471. 49831 15  08622 

220557173979. 063 
28193944904^0. 15 
743317395  805a83. 


1 . 00000000000000 

0     153587264.635352 

0. 732421875000000D-002 

0     153108097.868560 

0. 117187500000000D-001 

0     152485904.282359 

0. 625000000000000D-001 

0     150818862. 186507 

1. 00000000000000 

0     132047268.790020 

1 . 00000000000000 


0 


0. 244379043579102D-0 


steplength, gamma 

tt,  info,  rmax,      1 


0. 91542631 1736677D-0 14 
00000000000000 


1 . 00000000000000 

1    0. 596046447753906D-0 


r  0.7703719  77 
0. 208000433993821D 
0.  2021uS606962884D 
0. 183015730011275D 

1 . 00000000000002 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-457763664. 000000 

-0. 235098866120005D 

-0. 293873582650006D 

-0. 279861690229253D 

-0. 242667 16381 81 40D 


75489 
-031 
-029 
-027 


-024 

-0 

-022 

-0 

-020 

-0 

-018 

-0 

4D-033    0.^309268250566 
0. 96 29649721 936 18D- 031 
0. 9 1705080231 9 426D -029 
0. 795171792462780D-027 
-457763664. 000000 
-45  7763664.000000 
-457763664. 000000 
-457763664. 000000 
0. 596046447753906D-007 
131508428235878D-023 
1 3447655 1 4206 43 D- 021 
1 25 1 8544423 1580D-0 19 
103229 84 32 43272D -017 


44D-032 

0. 440652 

0. 410207 

0. 338263 

-4577636 

-4577636 

-4577636 

-4577636 

-0. 596046 

-0. 634766 

-0. 616899 

-0. 558519 


771275800D-0 

670714926D-0 

556158770D-0 

64. 000000 

64. 000000 

64. 000000 

64. 000000 

447753906D-0 

938524012D-0 

424698892D-0 

674263973D-0 


34 


RUN   #15 


8  Newton  steps 


xO     296.981125772494 
-40. 5170014433711 
78. 1184786292034 
95. 5765248137808 


805. 619158814028 
670. 077290135360 
■737. 687608386972 
•613. 386207147848 


51  . 6047080018680 
-975. 512313377759 
-6. 90543145820155 
-628. 146325780695 


tt, info, rmax. 


19. 0000000000000 


0 


744985996579. 413 


steplength, gamma     1863. 45202256309 
tt, info, rmax,      14.0000000000000 


1.00000000000000  1 

0     151289322.544588 


steplength, gamma     20. 6857895261084 
tt, info, rmax,      15.0000000000000 


0. 253906250000000D-001        2 
0     150658392.083229 


steplength, gamma     2.08038227471001 
tt, i nf o, rmax ,      16.0000000000000 


0.250000000000000  3 

0     144578667.929296 


steplength, gamma     35. 9811215440998 
tt, info, rmax,      18.0000000000000 


0. 488281250000000D-003       4 
0     144551342.269987 


steplength, gamma     6. 59190252887505 
tt, info, rmax,      19.0000000000000 


0. 781250000000000D-002       5 
0      144407436.410621 


steplength, gamma    0. 4558792291 19055 
tt. info, rmax,      12.0000000000000 


1.00000000000000  6 

0     135022355.068402 


steplength, gamma    0. 510872132671297 
tt, info, rmax,      12.0000000000000 


1.00000000000000  7 

0    0. 250339508056641D-00 


steplength, gamma    0. 938331531860259D-014 
tt, info, rmax,      12.0000000000000 


1.00000000000000  6 

0    0.000000000000000 


,  r     0.93889084788877 
0. 100918729085891D-030 
0. 156539585879795D-029 
0. 140022810676730D-028 

1 . 00000000000000 
-457763664. 000000 
-457763664.000000 
-457763664. 000000 
-457763664. 000000 
-0. 286526743083756D-023 
-0. 8181440540976 16D-022 
-0. 106828924764930D-020 
-0. 830557274228752D-020 


7D-032    0.3428155301009 
0. 268089448258703D-030 
0. 350057026691824D-029 
0. 272157012301249D-028 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 104618995423402D-022 
-0. 20500621 1256644D-021 
-0. 213657849529860D-020 
-0. 166111454845750D-019 


28D-031 

0. 671764364602268D-03 
0. 700114053383648D-02 
0. 544314024602498D-02 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
-457763664. 000000 
0. 000000000000000 
-0. 307979514617206D-02 
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